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"METHOD OF PROCESSING AND CORRESPONDING RLTERING DEVICE" 

FIELD OF THE INVENTION 

The invention relates to a method of processing data representing a sequence of 
pictures, previously encoded and decoded. 

The invention also concerns a filtering device for carrying out such a method. The 
invention is particularly relevant for the post-processing of a low brt-rate video signal that 
was previously compressed and decompressed. 

BACKGROUND ART 

Coding a sequence of pictures comprises different steps. Each picture is composed 
of a bi-dimensior>al array of picture elements or pixels, each of them having luminance and 
chrominance components. For encoding purpose, the picture is subdivided Into non- 
overlapping blocks of pixels. A discrete cosine transfomi (DCT) is applied to each block of 
the picture. The coeffidents obtained from this DCT are rounded to the closest value given 
by a fixed quantization law and then quantized, depending on the spatial frequency within 
the block that they represent. The quantized data thus obtained are then coded. During a 
decoding step, the coded data are successively decoded, treated by inverse-quantization and 
inverse discrete cosine transform, and finally filtered before being displayed. 

Quantization is, In data transmission, one of the steps for data compression and is a 
lossy treatment The quanti'zation errors introduced by quantization of the DCT coefficients 
in the coding have for main result the occurrence of ringing artifacts. This ringing noise is 
the Gtbb's phenomenon due to truncation of the high-frequency coefficients by quantization 
during encoding. Therefore ringing artifacts occur near high-frequency areas that are located 
on low activity regions and may appear as '^false edges" on the picture. 

A possible method for removing these ringing artifacts is proposed by Park et al in 
IEEE Transactions on CSVT, vol.9, no.l, February 1999, ppl61-171. The disclosed method 
comprises, for a given picture, a first step of edge detection followed by a low-pass filtering. 
The edge detection step makes use of a quantized factor QP taken from the encoding stage. 
Furthermore the proposed filtering step involves low-pass filtering of the luminance 
components by means of the derivation of weighted means of a defined set of luminance 
values. Thus, the method proposed by the prior art Involves the use of encoding 
parameters, which might not always be available at the edge detection stage and the low- 
pass filtering may introduce blurring effects in areas of the picture where extreme values of 
luminance can be found. 



SUMMARY OF THE INVENTION 

It is an object of the invention to propose an efficient method of processing picture 
data resulting in a picture of better quality and highly removed from artifacts due to a prior 
compression of the picture. 
5 To this end, a method, such as desaibed in the Introduction, comprises at least, in 

series, the steps of : 

detecting edge pixels within a picture, 

determining pixels to be filtered among pixels that are not detected as edges in the 
previous step, 

10 - replacing at least a pixel to be filtered with a pixel belonging to a close neighborhood of 
said pixel, said close neighborhood comprising said pixel and pixels adjacent to said pixel. 

In a method according to the invention, there is a first step of edge detection in 
order to predict the areas on the picture where ringing is likely to occur. Indeed ringing 
effects mainly appear in a picture in areas located along edges. These areas along edges 

15 may be filtered without disturbing the picture edges. The pixels belonging to these areas 
may be corrected by being replaced by an adjacent pixel. An advantage of the proposed 
correction of pbcels to be filtered is the high picture quality because the filter does not 
intnxJuce annoying blurring effects like the low-pass filter of the prior art. Another 
advantage of the invention is that the proposed method does not require any information 

20 from a previous treatment applied to the picture data as it was the case in the method 

disclosed by the prior art:. FurtJiemnore, a pixel, which is not detected as an edge pixel in the 
first step of a method according to the invention, is not necessarily filtered. A second step is 
performed in order to detenmine which pixels may be filtered according to set of criteria. 

In an embodiment of the invention, at least the pixel to be filtered is replaced with 

25 the median pixel of a set having an odd number of pixels that are not detected as edges, the 
set comprising at least once said pixel and pixels adjacent to said pixel. 

In this embodiment of the invention, a set is formed for a pixel to be filtered, with 
an odd number of pixels belonging to a dose neighborhood of said pixel. The median filter 
allows to replace a pixel value, that was not detected as an edge, by the median pixel value 

30 of this set associated to the pixel. Thus, thanks to this median filtering step any extreme 

value in the neighbortiood of the pixel is removed. In the document of the prior art, extreme 
pixels in the neighborhood of a pixel are taken into account In the filtering and may have a 
blurring infiuence on the filtered pixel. 

In another embodiment of the invention, the method is applied to the luminance 

35 component of the pixels of a picture. The human eye is very sensitive to the luminance 

component and therefore filtering the luminance components gives a very high processed 
picture quality. 



K 



The invention also concerns a filtering device for carrying out a method according to 
the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 The particular aspects of the invention will now be explained with reference to the 

embodiments described hereinafter and considered in connection with the accompanying 
drawings, in which : 

Rg.l is a block diagram of the various steps of a method according to the invention, 
Rg.2 is a scheme of a pixel neighborhood, 
10 - Rg.3 is a block diagram of an edge detection step according to the invention, 
Fig.4 gives the matrices used for the edge detection, 
Fig. 5 shows five neighboring blocks of pixels, 

Fig,6 is a block diagram of a step allowing to decide If a pixel should be filtered 
according to the invention. 

15 

DETAILED DESCRIPTION OF THE INVErfUON 

A method of processing data according to the invention is depicted in Rg.l. In this 
embodiment, the method is applied to successive pixels P[i,j]- In this embodiment of the 
Invention, the provided pixels P[l,j] belong to a frame in the spatial domain that was possibly 

20 in a previous treatment compressed and decompressed. An edge detection is performed 

during a step ED for each received pixel P[i,j] and allows to determine whether the received 
pixel P[i,j] is an edge or not. This step of edge detection will be explained in details in a 
paragraph hereinafter. A pixel P[iJ], which is detected as an edge during the edge detection 
step, is attributed an associated value EDG[i,j] of 1. A pixel P[ij], which Is not detected as 

25 an edge during the edge detection step, is attributed an associated value EDG[i,j] of 0. In 
the case the pixel P[i,j] is not detected as an edge, which means EDG[i,j] = 0, the pixel 
P[i,j] may be filtered In a spatially-adaptive filter SAF. Actually a pixel P[l,j], that was not 
detected as an edge, is filtered when additional conditions are satisfied. These additional 
conditions will be defined in a paragraph hereinafter. The decision of filtering a pixel P[i,j], 

30 that was not detected as an edge, is taken in a step TEST described hereinafter in relation 
with Fig.6. In the case the pixel P[i,j] is detected as an edge, it is not filtered and not 
modified. Indeed only pixels along edges but, which are not edges, may be filtered so that 
picture contours are preserved. 

In Rg.2, it is shown a pixel P(i,j] belonging to a picture to be processed. This pixel 

35 P[i,j] is sun^unded by eight adjacent pixels {P[i-lJ-l], P[i-lj], Pti-lJ+1], PCU+l], 

P[i+lJ+l], P[i+lJ], P[1+1J-1], P[i,j-1]} located in a close neighborhood of the pixel P[i,j]. 



The pixels P[ij-1L P[i-lJ]/ P[iJ+l]/ P[»+lj] are hereafter called the left pixel, the upper 
pixel, the right pixel and the lower pixel of P[ij], respectively. 

A possible way of performing an edge detection step ED according to the invention 
is depicted in Rg.3. In this embodiment of the invention, each picture may be divided into 
non-overlapping blocks of 4x4 pixels, each block having a number N[bck] of detected edges. 
This proposed step of edge detection ED, in accordance with the invention, is based, for 
each pixel P[i,j] on the luminance component Y[i,j] of the pixel P[i,j]. This is by no means a 
limitation of the invention and any pixel component may be used as the so-called pixel value 
in the calculations involved in such a step of edge detection. For each provided pixel P[i,j], 
an horizontal comfjonent GH[i,j] and a vertical component Gv[i,j] of a gradient G[i,j] are 
evaluated. A possible way of deriving a gradient is to use the Sobel matrices Sh and Sv given 
in Rg.4. Let us consider a matrix composed of the luminance component Y[i,j] of the pixel 
P[i,j] and the luminance components {Y[i-l,j-l], Y[i,j-1]} of the eight adjacent pixels 
{P[i-l,j-l], P[i,j-1]} as shown in Rg.4. The horizontal and vertical components GH[i,j], 
Gv[i,j] respectively, of the gradient G[i,j] are then derived as convolution products as 
follows : 



^J^H ['» y]+ t» j] • A Pix^'' having a greater gradient than its surrounding pixels, is more 



likely to be detected as an edge. 

Thus, as shown in Rg,3 In a first step 1, the gradient G[i,j] is derived for each pixel 
P[i,j] of a picture and a mean Gm of the various obtained gradients is also derived for the 
whole picture. Then, in a subsequent step 2 and for each provided pixel P[i,j], the gradient 
G[l,j] of the pixel P[i,j] is compared with the mean Gm. In the case the gradient G[i,j] is 
lower than half of the mean Gm the corresponding pixel P[i,j] is not detected as an edge 
and EDG[i,j] is set to 0. In the case the gradient G[l,j] is greater than half of the mean Gm, 
the pixel P[i,j] may be detected as an edge, and, the horizontal and vertical components 
GH[i,j], Gv[i,j] are in tum compared as described in the next paragraphs. 

In a step 3, when the horizontal component GH[i,j] is greater than the vertical 
component Gv[i,j] and, in a step 4, when the gradient G[i,j] is greater than both the 
gradient G[i,j-1] of the left pixel P[i,j-1] and the gradient G[f,j+1] of the right pixel P[i,j+1], 
the pixel P[i,j] belongs to a horizontal edge. In such a case, P[i,j] is detected as an edge and 
EDG[i,j] is set to 1 and the number N[bck] of detected edges in the block, to which P[i,j] 
belongs, Is incremented. 



Gy[ij]=Y*Sy 



The gradient G[i,j] is the modulus of the two components and is worth 




In the step 4, when the horizontal component GH[ij] is greater than the vertical 
component Gv[iJ] and when tfie gradient G[ij] is lower than either the gradient G[i of 
the left pixel P[i or the gradient G[ij+1] of the right pixel P[iJ+l], the pixel P[ij] is not 
detected as an edge and EDG[i j] is set to 0. 

In the step 3, when the horizontal component GH[i j] is lower than the vertical 
component Gv[i j] and, in a step 5, when the gradient G[i j] is greater than both the 
gradient G[i-1 j] of the upper pixel P[i-1 J] and the gradient G[i+l,j] of the lower pixel 
P[i+1 j], the pixel P[i j] belongs to a vertical edge. In such a case, the pixel P[iJ] is detected 
as an edge and EDGti j] is set to 1 and the number N[bck] of detected edges of the block, to 
which P[iJ] belongs, is incremented. 

In the step 5, when the horizontal component GH[i,j] is lower than the vertical 
component Gv[i,j] and, when the gradient G[i,j] is greater than either the gradient G[i-l,j] 
of the upper pixel P[i-l,j] or the gradient G[i+l,j] of the lower pixel P[i+l,j], the pixel Pp,j] 
is not detected as an edge and EDG[i,j] is set to 0, The proposed edge detection step only 
provides edges having a width of one pixel at most so that a fine filtering may be performed. 

In Rg.S a block A consisting of 4x4 pixels P[i,j] is surrounded by four non- 
overlapping 4x4 blocks B, C, D, E. Let us consider a pixel P[i,j] betonging to the block A, 
which was not detected as an edge during the edge detection step depicted in Fig.3, and 
which may be filtered. Thus, a pixel P[i,j] may be filtered when EDG[i,j] = 0. In an 
embodiment of the invention, any pixel P[i,j] that is not detected as an edge, is not 
necessarily filtered. Indeed additional conditions need to be satisfied as shown in Fig.6 
where operations performed in the TEST unit of Rg.l are depicted. Thus, for any pixel P[i,j] 
belonging to the block A and having a value EDG[i,j] of 0, the density of detected edges in a 
defined neighborhood of the pixel P[i,j] is taken into account. Thus, for example, a condition 
is set up for the total amount of edges in the block A and in the neighboring blocks B, C, D, 
E In a step 11, a first condition is tested : the total amount of edges in the blocks A, B, C, D 
and E must be lower than a predetermined maximum number of edges Nmax. Thus, the 
sum of the numbers of edges N(A), N(B), N(C), N(D), N(E) per block A, B, D, E, 
respectively must be lower than the defined number Nmax. In the case, the total amount of 
edges is greater than Nmax, there is too many edges in total in the five blocks A, B, C, D, E 
and the pixel P[i,j] is not filtered. In the case the number of edges in the five blocks A, B, C, 
D, E is not greater than Nmax, some additional conditions are set concerning the minimum 
number of edges per block in order to decide whether the pixel P[i j] shall be filtered. In 
subsequent steps 12, 13, 14, 15 and 16 the number of edges per block is compared with a 
minimum threshold Nmin. At least one of the block A, B, C, D and E must contain at least a 
minimum number of edges Nmln. When all these conditions are satisfied, the choice is made 
of transmitting the pixel P[i,j] to the spatially-adaptive filter SAP for filtering. Otherwise, 



when the total amount of edges in the five blocks A, B, C, D, E is greater than Nmax or none 
of the blocks contain at least Nmin edges, the pixel P[iJ] is not filtered. The order in which 
the steps 11, 12, 13, 14, 15, 16 are carried out in this embodiments is non restrictive and 
any other order can be chosen. The predetermined numbers Nmin and Nmax allow to adjust 
the precision of the method. Nmax is used to prevent filtering areas that are too complex 
and that could lead to degradations when filtered. Nmin will be chosen low enough so that 
the effect of the method is not reduced. 

In following paragraphs an example of a spatially-adaptive filtering step SAP is given 
in details. It must be noted that the term SAP may as well indicate a filtering step as a filter. 
Thus, a possible spatially-adaptive filter SAP replaces the luminance value Y[i,j] of the pixel 
P[i j] by the median value of a corresponding set S[i,j]. The set S[i,j] associated to the pixel 
P[i,j] may possibly comprise the luminance components Y[i,j], Y[i-l,j], Y[i+l,j], Y[i,j-1] and 
Y[i,j+1] of the adjacent pixels P[i,j], P[i-lj], P[i+l,jL PpJ-l] and P[i,j+1]- Each luminance 
component Y[i-l,j], Y[i+l,j], Y[i,j-1] or Y[i,j+1] effectively belongs to the set S[i,j] when the 
associated pixel P[i,j] is not detected as an edge. The set S[i,j] also comprises the value 
Y[i,j], that may be repeated so that the set S[i,j] is composed of an odd number of values. 
An even number of elements of the set S[i j] would oblige to derive the mean of the two 
median values of the set S[l,j], which would lead to a low-pass filtering. Table 1 gives for a 
given pixel P[i,j] that has to be filtered, the composition of the possible sets S[i,j] depending 
on the status of the adjacent pixels P[i-l,j], P[i+l,j], P[i/j-l], PpJ+l]/ whether they are 
edge pixels or not. 
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Tablel 



It must be noted from Tablel that, when the number of edges surrounding the pixel 
P[SJ] is greater than 3, the proposed filtering pattern is inactive for the pixel P[i,j], which Is 
kept unmodified. The proposed filtering pattern allows to eliminate any possible extreme 
value of the luminance component of a pixel belonging to the set S[i,j], Besides, since there 
is no low-pass filtering in the described filtering pattem, no blurring effect is introduced in 
the picture. 

It is to be noted that, with respect to the described coding method, modifications or 
improvements may be proposed without departing from the scope of the invention. For 
instance, it Is dear that this processing method can be implemented in several manners, 
such as by means of wired electronic circuits or, alternatively, by means of a set of 
instructions stored in a computer-readable medium, said instructions replacing at least a part 
of said circuits and being executable under the control of a computer or a digital processor 
in order to carry out the same functions as fulfilled in said replaced circuits. The Invention 
then also relates to a storing medium comprising a software module for storing a set of 
instructions executable under the control of a computer or a processor and provided for 
performing at least some of the steps of the processing method. The blocks in Fig.l, Fig.3 
and Ftg.6, represent both a step of a method according to the invention and a processing 
circuit of a global filtering device for performing such a step. 

It must be noted that in this text, the word "^comprising" does not exdude the 
presence of other elements or steps than those listed in a claim. 
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Claims : 

1. Method of processing data representing a sequence of pictures, previously encoded and 
decoded, comprising at least in series the steps of : 

5 - detecting edge pixels within a picture, 

- determining pixels to be filtered among pixels that are not detected as edges in the 
previous step, 

replacing at least a pixel to be filtered with a pixel belonging to a close neighborhood of 
said pixel, said close neighborhood comprising said pixel and pixels adjacent to said pixel. 

10 

2. Method of processing data as claimed in claim 1, wherein at least the pixel to be filtered 
is replaced with the median pixel of a set having an odd number of pixels that are not 
detected as edges, the set comprising at least once said pixel and pixels adjacent to said 
pixel. 

15 

3. Method of processing data as claimed in daim 1, wherein the method is applied to the 
luminance component of the pixels of said picture. 

4. Method of processing data as claimed in daim 1, wherein a pixel is detected as an edge 
20 pixel when a magnitude representative of a gradient of the pixel is greater than a 

predetermined threshold. 

5. Method of processing data as claimed in claim 4, wherein a pixel is detected as an edge 
pixel when the horizontal component of a gradient of said pixel is greater than the vertical 

25 component of said gradient and when the modulus of said gradient is greater than both the 
modulus of the gradient of the adjacent pixel on the left and the modulus of the gradient of 
the adjacent pixel on the right. 

6. Method of processing data as claimed in daim 4, wherein a pixel is detected as an edge 
30 pixel when the vertical component of a gradient of said pixel is greater than the horizontal 

component of said gradient and when the modulus of said gradient is greater than both the 
modulus of the gradient of the adjacent lower pixel and the modulus of the gradient of the 
adjacent upper pixel. 

35 7. Method of processing data as claimed in daim 1, wherein a pixel is filtered when the 
number of edges pixels in a defined neighborhood of the pixel is within a defined range. 




8. Filtering device for carr/ing out a method as claimed in daim 1. 



9. A storing medium comprising a software module for storing a set of instructions 
executable under the control of a computer or a processor and provided for performing at 
5 least some of the steps of the processing method as claimed in claim 1. 



10 

"METHOD OF PROCESSING AND CORRESPONDING RLTERING DEVICE" 

The invention concerns a method of processing data which can be pixels (P[iJ]) 
representing a sequence of pictures, previously encoded and decoded. The method 
5 comprises at least In series a first step (ED) of detecting edge pixels within a picture, 

followed by a subsequent step (TEST) in which a choice is made for the pixels, that are not 
detected as edges In the previous step, concerning the fact that these pixels may be filtered 
or not. Then, the method comprises a filtering step (SAF) which consists in replacing at least 
a pixel to be filtered with a pixel belonging to a close neighborhood of said pixel, said dose 
10 neighborhood comprising said pixel and pixels adjacent to said pixel. 
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